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(54) Digital transport stream processing 

(57) A device for use in a receiver/decoder for a 
broadcast digital television system in which received 
signals are passed through a receiver to the 
receiver/decoder and thence to a television set. The 
receiver/decoder decodes a compressed MPEG-type 
signal, and is controlled by a remote controller handset, 
through an interface in the receiver/decoder. The 
receiver/decoder includes a plurality of interfaces to 
external units, and logical driver devices for the inter- 



faces. The device produces a partial transport stream or 
an encapsulated data stream from the received broad- 
cast digital data stream under the control of an applica- 
tion. This may allow a desired data stream, for example 
containing selected programmes to be recorded by a 
digital video recorder coupled to receive the output of 
the device or may facilitate communication with a com- 
puter. 
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Description 



The present invention relates to interfacing of appli- 
cation programs to physical devices, particularly but not 
exclusively in the context of receiver/decoders for digital 5 
television systems. 

The advent of digital transmission systems 
intended primarily for broadcasting television signals, in' 
particular but not exclusively satellite television sys- 
tems, has opened up the possibility of using such sys- 10 
terns for other, purposes. One of these is to provide 
interactivity with the end user. 

The present invention finds specific application in a 
broadcast digital television system in which received 
signals are passed through a receiver to a 15 
receiver/decoder and thence to a television set The 
receiver/decoder (also known as a set-top-box or STB) 
decodes a compressed MPEG-type signal into a televi- 
sion signal for the television set. It is controlled by a 
remote controller handset, through an interface in the 20 
receiver/decoder. 

One way of providing the interactivity described 
above is to run an application on the receiver/decoder 
through which the television signal is received. It is 
desirable to enable a variety of applications to comma- 25 
nicate with a variety of physical devices in a transparent 
manner. Our co-pending applications PCT/EP97/021 15 
and PCT/EP97/021 1 6 describe systems in which one or 
more applications can be downloaded by a set-top-box 
(STB) and communicate with physical devices in the 30 
STB such as paralleled serial- interfaces and smart- 
card readers by means of a device driver for each 
device and an overall device manager. 

Pursuant to the present invention, it has been pro- 
posed to provide the capability for a set-top-box to pro- 35 
vide a digital output stream from a received data 
stream, for example to enable digital storage of received ' 
programmes and data, for example using a digital video * 
recorder, or to facilitate data communication with other 
devices, for example over a TCP/IP network. 40 

A problem with providing such a digital output 
stream is that the received data stream generally con- 
tains MPEG data at a very high bit rate, and it would be 
impractical to store the complete received data stream. 
In addition, the received data stream may contain much 45 
information which is not of interest to the viewer. A 
receiver decoder /contains apparatus for demultiplexing 
and if necessary£jescrambling a portion of the received 
data stream to provide a single channel for analogue 
display which can be recorded via a conventional ana- 50 
logue video recorder.. However, the conventional appa- 
ratus lacks flexibility and cannot provide a data stream 
suited for digital storage. 

Aspects of the invention propose novel techniques 
for providing a digital data stream suited to storage on a 55 
digital video recorder. Although the invention offers 
most advantages in processing an MPEG data stream 
containing a number of television programmes and 



other data received by a receiver/decoder (for cable or 
more preferably satellite) to proouce an output stream 
suitable for transmission to a digital video recorder it 
has been appreciated by the inventors that the invention 
can be applied to processing of other data streams, and 
can provide real-time editing of digital video. 

In a first aspect, the invention provides apparatus 
for processing a digital data stream comprising: 

means for receiving a digital data stream compris- 
ing a plurality of packets of information; 
means for storing a list of specified packets to be 
selected from the received digital data stream; 
means for extracting packets specified in said list 
from the received data stream; and 
means for combining the extracted packets to pro- 
duce an output data stream. 

Thus, with this aspect of the invention, specified 
packets can be extracted directly from the received data 
stream (which may also be termed the original transport 
stream) and selected portions, for example correspond- 
ing to one or more programmes, of interest, extracted 
and compiled into the output data stream (which may 
also be termed a partial transport stream). It will be 
appreciated that the apparatus offers considerable flex- 
ibility as it may be employed simply to copy an original 
transport stream containing data for several channels 
unchanged, or to select an individual packet of data. 

In a second aspect, the invention provides appara- 
tus for processing a digital data stream comprising: 

means for receiving a digital data stream compris- 
ing a plurality of packets of information; 
means for storing a list of specified sections to be 
selected from the received digital data stream; 
means for extracting sections specified in said list 
from the received data stream; and 
means for processing the extracted sections to pro- 
duce an output data stream. 



The means for processing the extracted sections 
can preferably perform one of a number of operations to 
encapsulate or package received MPEG sections in a 
suitable format. In a simple embodiment, processing the 
extracted sections may simply comprise stripping 
MPEG header information or other data from the sec- 
tions, for example by deleting portions of the segments, 
preferably at the beginning or the end, to extract the 
"raw" data for onward transmission. In such a case, 
addition of communication protocol specific headers 
and the like must be performed at the .sending end, by 
sending, for example, ready-prepared TCP/IP packets. 

Preferably, the means for processing the extracted 
sections includes means for adding at least one of a 
header and a footer, and preferably both, to a received 
section to provide a data stream conforming to a com- 
munication protocol other than the communication pro- 
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tocol of the received data stream. The section 
processing means may include means for adding a 
frame check sequence to the data. Inclusion of such 
features may reduce the amount of processing required 
at the transmitter, as well as reducing the amount of 
data that must be transmitted. In addition, the communi- 
cation protocol can be changed at the receiver/decoder. 

In each case, the received digital data stream is 
preferably an MPEG data stream (by which is meant 
any variant, modification or development of the basic 
MPEG format, preferably an MPEG-2 data stream) 
comprising a series of packets having respective packet 
identifiers (also termed PIDs). 

Particularly (but not exclusively) in the case of the 
first aspect, the list preferably comprises a list of packet 
identifiers to be selected from the received data stream. 

The list preferably also contains priority information 
indicating priority assigned to each packet, the appara- 
tus being arranged to include packets with higher prior- 
ity in the output stream in preference to packets with 
lower priority in the event of the number of packets to be 
combined becoming too great for the data handling 
capacity of the output stream. In this way, less important 
information, for example associated with a programme 
of lesser interest can be discarded leading to a deterio- 
ration in quality of that programme whilst another pro- 
gramme is more reliably recorded. 

Particularly (but not exclusively) in the case of the 
second aspect, the list preferably comprises a list of 
sections, each section being identified according to a 
numeric value in a specified field in the section. The 
section is preferably specified by defining a field of a first 
predetermined number of bits at an offset of a second 
predetermined numbW of bits from an identified point, 
preferably the start, in the section. 

The apparatus may include means for logging the 
identifiers of sections received. The logging means may 1 
comprise means for defining a bitmap, each bit in the 
bitmap corresponding to a section received or expected 
to be received, and means for altering the state of the bit 40 
corresponding to a received section to signify reception 
of that section. 

The apparatus preferably includes means for stor- 
ing at least one further list of packet identifiers and 
applying one or more specified processing operations, 45 
for example de£crambling, to packets specified in the or 
each further List prior to inclusion in the output data 
stream. This /allows, for example, a scrambled pro- 
gramme to b<3 descrambled and stored in descrambled 
form - , " ' 50 

The apparatus preferably also includes means for 
inserting further data, for example packets or sections, 
into the output data stream. The apparatus is preferably 
arranged to receive the further data from an application. 
This enables other information, for example information 55 
identifying the programmes included in the output data 
stream, to be stored, or enables other data generated 
by an application receiving the original transport stream 
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to be stored. 

The apparatus is most preferably implemented as a 
device in a receiver/decoder, for example for a digital 
satellite system as described in our co-pending applica- 
s tions PCT/EP97/02106 - 021 1 7. In such an implementa- 
tion, the device can operate under the control of an 
application, via a device manager, providing a conven- 
ient and flexible arrangement for controlling the compo- 
sition of the output data stream. The device is preferably 
10 arranged to communicate with the digital video recorder 
using a high-speed digital interface, such as the IEEE 
1394 interface, using a suitable device driver, such as 
the one described in our application filed concurrently 
herewith and bearing the attorney reference 
15 PDC/IK/1 9829, but can be used with any suitable digital 
interface. 

The second aspect in particular may be arranged to 
provide a virtual TCP/IP connection to a computer, by 
receiving broadcast MPEG packets and encapsulating 
20 the packets to provide a TCP/IP data stream to the com- 
puter. In such a case, communication may be via a 
serial or parallel port, preferably an enhanced or bidirec- 
tional parallel port. * »* - 
In a third aspect, the invention provides a device for 
25 operating under the control of an application to process 
a received digital data stream to produce an output 
stream therefrom, the device comprising: 

means for receiving a digital data stream compris- 
ing a plurality of packets of information; 
means for receiving from an application information 
for compiling a list of specified packets or sections 
to be selected from the received digital data stream; 
means for extracting packets or sections specified 
in said list from the received data stream; and 
means for combining the extracted packets ^or 
encapsulating the extracted sections to produce 
said output data stream. 

The device preferably operates -in one of two 
modes, an idle mode in which no output stream is being 
produced and a running mode in which data is passing 
through the device. Although production of the output 
stream could be stopped simply by specifying no pack- 
ets for inclusion, provision of an idle mode may allow a 
more efficient use of system resources. The device pref- 
erably also includes means for receiving commands 
from an application for starting and stopping output 
stream generation (for switching between modes). 

Preferably, in said idle mode, the device is arranged 
to receive information for compiling said list in the form 
of an initial list of all packet identifiers to be copied to the 
output stream. This allows the initial list to be set effi- 
ciently. Thereafter, in running mode, the device is pref- 
erably arranged to receive a list of packet identifiers to 
be added to or deleted from the current list. In this way, 
to update the list, it is not necessary to handle increa? 
ingly long lists and to keep track of all previous pack 
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identifiers; this is particularly advantageous as running 
mode processing may be more time-critical than idle 
mode processing. 

In a similar manner to the initial storing of lists of 
packets to be copied in idle mode, and the adding and 
de etmg-of entries in running mode, the device is prefer- 
ably arranged to maintain a further list of packets to be 
descrambled, preferably by descrambling means of the 
receiver/decoder used to descramble programmes for 
display. In addition, the device may be arranged to 
rece.ve information for use in descrambling from an 
application, preferably as part of a procedure for setting 
the imtial list of packets to be descrambled. 

In addition to storing lists of packets to be copied 
directly, the device preferably also includes, in a similar 
manner, means for storing a list of MPEG sections from 
the received data bitstream to be inserted in the output 
bitstream. H 

The device preferably further includes means for 
storing a list of MPEG sections to be inserted by an 
application. Preferably, the device is arranged to receive 
parameters from an application for controlling repetition 
of the section in the output stream and the device is 
arranged to repeat the section based on the parame- 
ters. This allows production of complicated data 
streams with relatively little input from an application 
For example, an application can send a simple com- 
mand to insert a section identifying the programmes 
included in the output stream, and this can automati- 
cally be inserted at regular intervals into the output 
stream by the device. . 

The device preferably includes means for returning 
to an application information concerning the currently 
selected packet identifiers or sections included in the 
output stream. 

Functions of the device may be implemented in 
hardware, for example in a dedicated integrated circuit- 
this may provide enhanced speed of operation. Prefera- 
bly, however, at least some of the device driver is imple- 
mented in software, preferably run by processing 
means which runs the application; this allows greater 
flexibility, requires less components, and allows the 
device driver to be updated more readily. 

In a fourth aspect, the invention provides a data 
processing system comprising: 



run-time engine means for running at least one 
application; / 

means for receiving a broadcast digital data 
stream; 

a device, preferably as defined above, for process- 
ing the received digital data stream under the con- 
trol of the or each application; 
means for supplying the data stream output by the 
device to an output interface. 

Preferred features of the first and second aspects 
may be applied to the third and fourth aspects. 



The data processing system is preferably imple- 
mented in a receiver/decoder (for example a set-top- 
box wh,ch includes means for receiving the broadcast 
digital data stream from a satellite receiver or cable the 
s interface being arranged for connection to a digital video 
recorder (which term is meant to include any suitably 
conf.gured digital storage device capable of storing data 
for a television program, regardless of the physical 
medum in which the data is actually stored) or digital 
n display device or computer for display or storage of at 
least a portion of the received date. The device is pref- 
erably arranged to cooperate with a device driver for 
outputtmg the output data stream to a high-speed 
upwards, preferably at least iMbit/s 
is 1 0Mbit/s or higher) digital interface. 

The interface preferably conforms to the IEEE 1394 
standard or a variant or modification thereof. 

Where the system is implemented in a 
receiver/decoder arranged for connection to a digital 
20 video recorder, the receiver/decoder preferably includes 
an application arranged to control the device to select 
portions (packets or sections) of the received data 
stream comprising two or more, television programmes 
for outputting to the digital video recorder and preferably 
25 including means for adding information to the output 
data stream identifying the programmes. In this way a 
user may select two or more programmes for recording 
for viewing at a later time; this would conventionally 
require two or more analogue video recorders and two 
30 or more receiver/decoders. The application may include 
means for controlling the video recorder, for example as 
described in our co-pending application bearing the 
attorney reference PDC/IK/19931 filed herewith the 
disclosure of which is herein incorporated by reference 
35 u 711,8 featUre may be P rov 'ded independently, in a 
^ fifth aspect, in which the invention provides an applica- 
^ toon for a receiver/decoder having means far-receiving a 
broadcast digital data stream, an interface for connec- 
tion to a digital storage medium, and a device for 
« processing the received digital data stream to produce 
an output data stream for supply to the digital storage 
medium, the application comprising means for control- 
Ung said device to select portions of the received digital 
data stream corresponding to two or more broadcast 
45 programmes and for outputting the portions to the digital 
storage medium for storage in a form enabling the pro- 
grammes to be played back subsequently. 

The application is preferably run in an interpreted 
language and the device driver is preferably compiled 
so ^ Embodiments incorporating preferred features of 
the present invention will now be described, purely by 
way of example, with reference to the accompanying 
drawings, in which:- • 



55 



Figure 1 is a schematic diagram of interfaces of the 
receiver/decoder; 

Figure 2 is a functional block diagram of the 
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receiver/decoder; 

Figure 3 shows certain components of the virtual 
machine and run time engine in more detail; 

Figure 4 shows a schematic overview of the func- 
tions provided by a first device embodying the 
invention; 

Figure 5 is a schematic diagram for explaining the 
insertion of repeated sections into the output data 
stream; 

Figure 6 is a schematic overview of the functions 
provided by a second device embodying the inven- 
tion; 

Figure 7 is a schematic diagram of a datagram pro- 
duced by the embodiment of Fig. 6. 
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To assist in understanding of the device, the pre- 
ferred platform on which the device operates, our digital 
satellite.receiver/decoder will first be described briefly. 25 

Referring to Fig. 1, a receiver/decoder 2020 or set- 
top-box for use in a digital interactive television system 
in which the device driver of the embodiment is intended 
to be installed is schematically depicted. Details of a 
suitable digital interactive television system may be so 
found in our co-pending applications PCT/EP97/021 06 - 
021 1 7 to which reference should be made, and the dis- 
closures of which are herein incorporated by reference. 
For ease of reference, parts described in more detail in 
the aforementioned specifications are generally desig- 3s 
nated by the reference numerals used in those specifi- 
cations. 

As described in more detail in the aforementioned spec- 
ifications, referring to Figure 1, the receiver/decoder 
2020 includes several interfaces; specifically, a tuner 40 
4028 for the MPEG signal flow, a serial interface 4030, 
a parallel interface 4032, and two card readers 4036,' 
one for a smartcard forming part of the system and one 
for bank cards (used for making payments, home bank- 
ing, etc) or another smart ..card. The receiver/decoder 45 
also includes in interface 4034 to a modemmed back 
channel 4002 ho the television signal producer, so that 
the user can indicate preferences, etc back to the televi- 
sion signal (programme) producer. The receiver also 
comprises a pun-Time-Engine 4008, a Device Manager so 
4068 and a plurality of Devices 4062 for running one or 
more applications 4056. 

For the purposes of this specification, an applica- 
tion is a piece of computer code for controlling high level 
functions of preferably the receiver/decoder 2020. For 55 
example, when the end .user positions the focus of a 
remote controller on a button object seen on the screen 
of the television set 2022 and presses a validation key, 



the instruction sequence associated with the button is 
run. 

An interactive application proposes menus and exe- 
cutes commands at the request of the end user and pro- 
vides data related to the purpose of the application 
Applications may be either resident applications that is 
stored in the ROM (or FLASH or other non-volatile 
memory) of the receiver/decoder 2020, or broadcast 
and downloaded into the RAM or FLASH memory of the 
receiver/decoder 2020. 

Some examples of applications, described in more 
detail in the aforementioned applications are:- 

• An Initiating Application which is an adaptable col- 
lection of modules enabling the receiver/decoder 
2020 to be immediately operative in the MPEG-2 
environment. 

• A Startup Application which allows any application, 
either downloaded or resident, to run on the 
receiver/decoder 2020. 

• A Program Guide which is an interactive application 
which gives full information about programming. 

• A Pay Per View application which is an interactive 
service available on each PPV channel of the digital 
TV bouquet to enable the end user to buy the cur- 
rent event. 

• A PC Download application enabling an end user to 
download computer software using the PC down- 
load application. 

• A Magazine Browser application comprising a 
cyclic video broadcast of images with end user nav- 
igation via on-screen buttons. 

• A Teleshopping application enabling offers of goods 
for sale to be transmitted to the receiver/decoder 
2020 and displayed on the television 2022 and ena- 
bling the user to select a particular item to buy. * 

Applications are stored in memory locations in the 
receiver/decoder 2020 and represented as resource 
files. The resource files comprise graphic object : 
description unit files, variables block unit files, instruc- 
tion sequence files, application files and data files as 
described in more detail in the above mentioned speci- 
fications. 

In the MPEG data stream, each module comprises 
a group of MPEG tables. Each MPEG table may be for- 
matted as a number of sections. In the MPEG data 
stream, each section has a "size" of up to 4 kbytes. For 
data transfer via the serial and parallel port, for exam- 
ple, modules similarly are split into tables and sections, 
the size of the. section varying with the transport 
medium. ...... . - 

Modules are transported in the MPEG data stream \ 
in the form of data packets of typically 188 bytes within / 
respective types of data stream, for example, video data ' 
streams, audio data streams and teletext data streams. 
Each packet is preceded by a Packet Identifier (PID) o' 
13 bits, one PID for every packet transported in tr- 



IO: <EP 08939 13A1 J_> 



^ J 



EP0 893 913 A1 



10 



MPEG data stream. A programme map table (PMT 
table) contains a list of the different data streams and 
defines the contents of each data stream according to 
the respective PID. A PID may alert a device to the pres- 
ence of applications in the data stream, the PID being 5 
identified using the PMT table. 

The decoder contains memory divided into a RAM 
volume, a FLASH volume and a ROM volume, but this 
physical organization is distinct from the logical organi- 
zation. The memory may further be divided into mem- 10 
ory volumes associated with the various interfaces 
From one point of view, the memory can be regarded as 
part of the hardware; from another point of view, the 
memory can be regarded as supporting or containing 
the whole of the system shown apart from the hardware, 15 

The system can be regarded as centred on a run 
time engine 4008 forming part of a virtual machine 
4007. This is coupled to applications on one side (the 
"high level" side), and, on the other side (the "low level- 
side), via various intermediate logical units discussed 20 
below, to the receiver/decoder hardware 4061. The 
receiver/decoder, hardware can be regarded as includ- 
ing the various ports or interfaces as discussed above 
(the interface 2030 for the handset 2026, the MPEG 
stream interface 4028, the serial interface 4030, the 25 
parallel interface 4032, the interfaces to the card read- 
ers 4036, and the interface 4034 to the modemmed 
back channel 4002). 

With reference to Figure 2, various applications 
4057 are coupled to the unit 4007; some of the more so 
commonly used applications may be more or less per- 
manently resident in the system, as indicated at 4057 
while others will be downloaded into the system, eg 
from the MPEG data stream or from other ports as 
required. 35 

The unit 4007 includes, in addition to the run time 
engine 4008, some resident library functions 4006 ' 
which include a toolbox 4058. The library contains mis- ^ 
cellaneous functions in C language used by the engine 
4008. These include data manipulation such as com- ao 
pression. expansion or comparison of data structures 
line drawing, etc. The library 4006 also includes infor- 
mation about firmware 4060 in the receiver/decoder 
2020, such as hardware and software version numbers 
and available RAM space, and a function used when 45 
downloading a npv device 4062. Functions can be 
downloaded into Ahe library, being stored in Flash or 
RAM memory. / 

The run time engine 4008 is coupled to a device 
manager 4068 which is coupled to a set of devices 4064 so 
which are coupled to device drivers 4060 which are in 
turn coupled to the ports or interfaces. In broad terms, a 
device driver can be regarded as defining a logical inter- 
face, so that two different device drivers may be coupled 
to a common physical port. A device will normally be 55 
coupled to more than one device driver; if a device is 
coupled to a single device driver, the device will nor- 
mally be designed to incorporate the full functionality 



required for communication, so that the need for a sep- 
arate device driver is obviated. Certain devices may 
communicate among themselves. 

As will be described below, there are 3 forms of 
communication from the devices 4064 up to the run time 
engine: by means of variables, buffers, and events 
which are passed to a set of event queues. 

Each function of the receiver/decoder 2020 is rep- 
resented as a device 4062. Devices can be either local 
or remote. Local devices 4064 include smartcards, 
SCART connector signals, modems, serial and parallel 
interfaces, a MPEG video and audio player and an 
MPEG section and table extractor. Remote devices 
4066, executed in a remote location, differ from local 
devices in that a port and procedure must be defined by 
the system authority or designer, rather than by a device 
and device driver provided and designed by the 
receiver/decoder manufacturer. 

When a new device 4062 is created, it can be 
installed in existing receiver/decoders 2020 by down- 
loading the relevant application 4056 from the broad- 
cast centre. This downloading is performed in the 
receiver/decoder 2020 by an application 4056 which 
checks the hardware and software versions and, if cor- 
rect, loads the software module representing the new 
device 4062 and asks a procedure of the library 4006 to 
install the new device code within the firmware (in Flash 
memory). This can provide a flexible and secure instal- 
lation of new functions within the receiver/decoder 2020 
without affecting the rest of the software. 

The device manager 4068 is a common software ~ 
interface between the application 4056 and the specific 
functions of the receiver/decoder 2020. The device 
manager 4068 controls access to devices 4062 
declares receipt of an unexpected event, and manages 
shared memory. 

The run time engine 4008 runs under the control of 
the microprocessor and a common application pro- 
gramming interface. They are installed in every 
receiver/decoder 2020 so that all receiver/decoders 
2020 are identical from the application point of view. 

The engine 4008 runs applications 4056 on the 
receiver/decoder 2020. It executes interactive applica- 
tions 4056 and receives events from outside the 
receiver/decoder 2020, displays graphics and text, calls 
devices for services and uses functions of the library 
4006 connected to the engine 4008 for specific compu- 
tation. 

The run time engine 4008 is an executable code 
installed in each receiver/decoder 2020, and includes 
an interpreter for interpreting and running applications. 
The engine 4008 is adaptable to any- operating system, 
including a single task operating, system (such as MS- 
DOS). The engine 4008 is based on process sequencer 
units (which take various events such as a key press, to 
carry out various actions), and contains its own sched- 
uler to manage event queues from the different hard- 
ware interfaces. It also handles the display of graphics 
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and text. A process sequencer unit comprises a set of 
action-groups. Each event causes the process 
sequencer unit to move from its current action-group to 
another action-group in dependence on the character of 
the event, and to execute the actions of the new action- 5 
group. 

The engine 4008 comprises a code loader to load 
and download applications 4056 into the 
receiver/decoder memory 2028. Only the necessary 
code is loaded into the RAM or Flash memory, in order w 
to ensure optimal use. The downloaded data is verified 
by an authentication mechanism to prevent any modifi- 
cation of an application 4056 or the execution of any 
unauthorized application. The engine 4008 further com- 
prises a decompressor. As the application code (a form is 
of intermediate code) is compressed for space saving 
and fast downloading from the MPEG-2 transport 
stream or via a built-in receiver/decoder mode, the code 
must be decompressed before loading it into the RAM. 
The engine 4008 also comprises an interpreter to inter- 20 
pret the application code to update various variable val- 
ues and determine status changes, and an error 
checker. 

Before using the services* of ~any device 4062, a 
program (such as an application instruction sequence) 25 
has to be declared as a "client", that is, a logical access- 
way to the device 4066 or the device manager 4068. 
The manager gives the client a client number which is 
referred to in all accesses to the device. A device 4066 
can have several clients, the number of clients for each 30 
device 4066 being specified depending on the type of 
device 4066. A client is introduced to the device 4066 by 
a procedure "Device: Open Channel". This procedure 
assigns a client number to the client. A client can be 
taken out of the device manager 4068 client list by a 35 
procedure "Device: Close Channel". 

The access to devices 4062 provided by the device 
manager 4068 can be either synchronous or asynchro- 
nous. For synchronous access, a procedure "Device: 
Call" is used. This is a means of accessing data which 40 
is immediately available or a functionality which does 
not involve waiting for the desired response. For asyn- 
chronous access, a' procedure "Device: I/O" is used. 
This is a means of accessing data which involves wait- 
ing for a response, for example scanning tuner frequen- as 
cies to find a chultiplex or getting back a table from the 
MPEG strearrt. When the requested result is available, 
an event is put in the queue of the engine to signal its 
arrival. A further procedure "Device: Event" provides a 
means of managing unexpected events. 

As noted above, the main loop of the run time 
engine is coupled to a variety of process sequencer 
units, and when the main loop encounters an appropri- 
ate event, control is temporarily transferred to one of the 
process sequencer units. * . 

Referring to Fig. 3, the device manager includes a 
queue 100 into which events from the devices are 
passed for temporary storage. At suitable intervals, the 



virtual machine sends a signal to this queue to extract 
the first item from it. This event item is moved to a queue 
structure 101 in the virtual machine. Depending on the 
priority level of the event item, it is inserted into the 
appropriate one of the 5 queues 0 to 4. Event items are 
extracted from the queue structure 101 by a queue 
selector unit 102 under the control of the run time 
engine. 

When an event is selected from the queue structure- 
101, it is passed to a process sequencer unit engine 
104, which consists of a process sequencer unit driver 
105 and a set of process sequencer units 106. Each 
process sequencer unit is a set of action-groups linked 
together, so that each step from one action-group to the 
next action-group is, in general, dependent on the cur- 
rent action-group and the nature of the event. Different 
process sequencer units have different sizes and com- 
plexities, including one in which the "next" action-group, 
ie the action-group to which the system steps on in 
response to an event, is dependent solely on the nature 
of the event but is independent of the current action- 
group. Also, as is shown at the right-hand side of the 
process sequencer units block, there may be several 
copies of a process sequencer unit, ie several identical 
process sequencer units, to deal eg with several sepa- 
rate data streams using identical protocols through a 
single port. 

When an event is selected, it is passed to the 
appropriate process sequencer unit. This selects the 
appropriate outlet from the current action-group on the 
process sequencer unit. This results in the appropriate 
next action-group being selected and the actions in that 
action-group being performed, involving eg the sending 
of a message to the device manager or the execution of 
a instruction sequence. Action-groups in the process 
sequencer unit can also send event messages totother 
process sequencer units. 

If a instruction sequence is selected, the identifica- 
tion of the instruction sequence is sent to a instruction 
sequence selector 107. This obtains the desired* 
instruction sequence from a instruction sequence mem- 
ory 108 and passes it to a instruction sequence inter- 
preter 109, which executes the instruction sequence. 

The system also includes a filter 110, which is 
loaded with event types eg from the process sequencer 
units 1 06. When an event item is passed from the queue 
100 in the device manager to the queue structure 101 in 
the virtual machine, its type or character is matched 
against the list in the filter 110, and if it is of a type which 
is not recognized, it is rejected. This ensures that if say 
the device manager or the keyboard generates events 
of a type which the virtual machine cannot deal with, 
those events are not passed to the queue structure 101 . 
(If events of this kind were passed to the queue struc- 
ss ture 101, either they would accumulate in that queue 
structure or they might cause malfunctioning of the 
process sequencer unit engine 1 04.) 

Thus, it can be seen that our basic system provide? 
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a platform having considerable flexibility in enabling an 
application to communicate with a variety of devices. 

SIGNAL PROCESSING ncx/^ F g 

Two signal processing devices which embody the 
invention will be described; the two devices may both be 
provided simultaneously in the same receiver/decoder 
each device being tailored to provide slightly different 
functions. 

A first signal processing device which remultiplexes 
a demultiplexed received transport stream to produce 
an output partial transport stream, typically containing 
some but not all of the information in the original trans- 
port stream, and possibly additional information will now 
be described, with reference to Fig. 4. For ease of refer- 
ence, the device will be referred to below as a 
TS.REMUX device (abbreviation for Transport Stream 
RE-MUItipleXer). 

TS RE-MI iy nrx/ir.c 



The Ts_Remux device can be considered as com- 
prising a number of functional units, hereinafter termed 
commands. In addition, as will be appreciated the 
device contains underlying functionality for actually 
implementing the functions performed by the various 
commands. For example, actual selection of packets 
from the received data stream may be implemented by 
means of dedicated hardware which filters the data to 
extract packets corresponding to defined packet identifi- 
ers, the list of packet identifers being supplied under 
software control based on information supplied by an 
application via one of the commands described below 
In the following discussion.it should be noted that upper 
and lower case versions of a command name are both 
intended to refer to the same command. 

The precise details of the implementation of the 
various functions, and the distribution between hard- 
ware and software are a matter of choice for the imple- 
mentor and will not be described in detail. It is. however 
noted that dedicated integrated circuits capable of per- 
forming filtering operations on an MPEG data stream 
are commercially available, and these can be used as 
the basis for a hardware accelerator, or more preferably 
modified to produce a dedicated hardware accelerator 
to implement various of the packet selecting operations 
required, thereby reducing the processing power 
required to run the software. However, the operations 
required may be implemented in software if sufficient 
processing powe'r is available. 

The device is arranged, to operate in one of two 
modes, an idle mode in which no output is being pro- 
duced and a running mode in which data is being con- 
veyed to the output data stream. In the running mode 
as will be appreciated, more system resources are 
required by the device. The operation of the commands 
described below may be dependent on the mode of 



operation, and, in particular, most commands will only 
operate in only one mode, and return an error if 
accessed in the other mode. 

Each command interfaces with an application 
s under the control of the device manager 4068 by means 
of one of the three standard procedures mentioned 
above, which are common to other devices. Information 
may be passed between an application and the device 
by means of parameter tables. For ease of reference 
'o the three basic procedures are summarised briefly 
below:- ' 



15 



20 



25 



30 



35 



1) Device: Call. This command can be used by an 
application for performing synchronous commands 
or data transfer. Execution of the application is sus- 
pended until control is returned when the operation 
by the device driver has completed; this allows 
operations which must be performed in strict 
sequence to be controlled reliably. 

2) Device: I/O. This command allows asynchronous 
operation. That is. an application can send a 
request for a data transfer or a particular function to 
be performed by the device driver and execution of 
the application can continue while the data transfer 
or function is performed by the device driver. 

3) Device: Event. The event trapping function ena- 
bles events to be signalled by the device to an appli- 
cation, and for particular action to be taken by the 
application in response to the event independently 
of the code the application is executing at the time 
the event is signalled; effectively the application is 
mterupted. Events may be prioritised. Events may 
be used to signal events occuring on the interface 
such as a bus reset, or to provide monitoring of 
asynchronous commands, for example by signal- 
ling completion of a requested data transfer. 



40 



The commands provided in a device embodying the 
invention will now be described. Each command may be 
accessed by an application by passing an identifier of 
the command as a parameter via one of the above three 
standard procedures. Not all of the commands 
45 described below need be provided, and the functions of 
the commands may be altered. Although the commands 
may be independently provided or altered, as will be 
appreciated, certain synergistic benefits accrue from 
the combined functionality provided by the commands 
so described. 

The commands will be described in terms of the 
features and functions provided by each command 
together with optional and preferable features. With the 
information given and specifications provided, actual 
55 implementation of these features should be straightfor- 
ward for one skilled in the art. and the precise details 
are left to the implementor. As anexample, each com- 
mand could be implemented in software, preferably writ- 
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ten in the C programming language and preferably 
compiled to run on the processor used to run the appli- 
cation; however the device driver may be run on a sep- 
arate processor, and some or all commands may be 
implemented by dedicated hardware. The Call and IO 5 
commands may signal information or pass parameters 
back to an application by setting values in a parameter 
table stored in memory whose address is passed to the 
device. 



Command: TS . REMUX SET Pin 



Command: TSJ 3EMJJX SET SCR PIP 



Command: TS REMUX SET DATA PIP 

This command operates similarly to the Set_PID 
command described above, and is used to specify 
packet identifiers of MPEG sections from the application 
to be included in the output data stream. 



w 



This command operates only in the idle mode and 
is arranged to receive an initial list of packet identifiers 
(PIPs), each with an associated priority value (prefera- 75 
bly a single byte encoding a priority from 0 to 255) to be 
copied from the input data stream to the output data 
stream. The command is preferably accessed synchro- 
nously by means of the Device: Call procedure. In the 
event of the device receiving more packets to copy than 20 
can be handled by the output stream, the packets 
whose priority values are lowest are dropped first. 



25 



This command operates similarly to the Set_PID 
command described above, , and is used to specify 
packet identifiers of packets to be descrambled before 
inclusion in the output data stream. In addition to a list of 
packet identifiers and priorities, the command receives 30 
information necessary for descrambling the packets; 
This information may include a mode indicator specify- 
ing the type of processing to be performed on each 
packet, session and index numbers, an operator refer- 
ence, the PID of the packet to be descrambled and the 35 
PID of the packet containing the ECM to use in 
descrambling. { 



40 
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Command: TS fiEMLJX SET SECTION 

This comr/and operates similarly to the Set_PID 
command described above, and is used to specify 
packet identifiers of MPEG sections to be included in 50 
the output data stream. In addition, the application can 
specify a number of parameters including an OFFSET 
specifying a delay from the start of running mode, a 
REPEAT parameter specifying the number of times a 
section is to be repeated, a DELAY between packets of 55 
the section, a CYCLE parameter specifying the time 
from the start of one section to the next repetition of the 
section and a CYCLE_2 parameter specifying the time 



from the start of one series of repetitions to the start of 
the next series of repetitions. The function of these 
parameters will be understood better with reference to 
Fig. 5. 

Command: TS REMUX APD Pin 

As mentioned above, the Set_PIP command only 
operates in idle mode. In running mode, the Add_PID 
command enables an application to add PIDs to the cur- 
rent list of PIDs specified for copying to the output 
stream. The device includes a complementary com- 
mand Ts_Remux_Stop_PID, which deletes PIDs from 
the current list. The PIDs are preferably specified in the 
same manner as for the Set_PID command, including a 
priority for each command. Because the editing of PIDs 
in a list may require some time for the list to be updated 
when the device is in running mode, these commands 
are preferably accessed asynchronously via the Device: 
I/O procedure. 

In addition, analogous procedures are provided for 
dynamically adding to or deleting from the lists of pack- 
ets to be descrambled, sections to be copied, or sec- 
tions to be inserted, by means of 

Ts_Remux_{Add;Stop}_(SCR__PID;Data_PID;Section} 
commands. . : . ■ 

For switching from idle mode to running mode, the 
command Ts_Remux_Start is provided, and for switch- 
ing from running mode back to idle mode, command 
Ts_Remux_Stop is provided. Both of these commands ■ 
are preferably accessed asynchronously via the Device: 
I/O procedure. 

In addition, for returning information concerning the 
PIDs, the encrypted PIDs and the sections included in 
the current output stream, the commands - 
Ts_Remux_P ID Jnfo, Ts_Remux_ECM Jnfo and 
Ts_Remux_lnfo_Section are provided. These return a 
list of current PIDs in similar format to that supplied by 
an application using the correpsonding Set or Add com- 
mands. . 

In addition to the commands, which allow an appli- 
cation to send commands to the device, the device is 
arranged to signal certain events to an application, via 
the device manager's event handling functions. The 
device implements the following events: 

Event: EV T S REMUX ECM 

This event is used to signal rejection of an ECM by 
the RSM. The device passes the PID of a packet where 
the ECM was found and the address of a buffer storing 
the rejected ECM. together with status words. - 

Event EV TS REMUX GETALL * 

This event is used to signal the response of the 
RSM to an application when an ECM is sent to th 
RSM. 
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Event: FV TS REMUX RAn mr 



This event signals reception of an ECM with an 
unexpected session or index number; the ECM is not 
sent to the RSM. 



example serial, parallel, IEEE 1394) without requiring 
port-specific information to be used with other com- 
mands in the device. 

5 Command: MCQM INJiT FILTER 



Event: EV TS RFMI ix STREAM 

This event is used to signal a change in stream 
composition, when the priority associated with a PID 
has been used to control skipping or adding of PIDs in 
the output stream. 

A second device embodying the invention will now 
be described, with reference to Figs. 6 and 7 This 
device will be referred to as MCOM (abbreviation for 
MPEG Communications), and is primarily intended to 
encapsulate received MPEG sections to provide a vir- 
tual TCP/IP data source from a satellite link. 

MCOM DEVICE 

This device, like the TS_REMUX device, is com- 
posed of a number of commands. Many of the com- 
mands perform analogous functions to commands of 
the TS_REMUX device, so will not be described in 
detail. Like the TS_REMUX device, the MCOM device 
preferably operates in either a running mode or an idle 
mode and has commands for switching between 
modes. In place of commands for adding and deleting 
packets from the output data stream, the MCOM device 
comprises commands for selecting sections to be 
included, for deleting portions of sections (or, viewed 
another way, extracting portions of sections to be 
included) and for altering parameters of the header (if 
present), footer (if present), and data, checking (if 
present) to be added to received sections (or the portion 
thereof to be included in the output data stream) The 
device provides flexibility, by allowing any of a number of 
communication protocols to be simulated with minimal 
interaction required by an application during running. 

The device may be able to operate in an automatic 
mode, in which, after defining filtering to be performed 
on the received data, sections are automatically queued 
to the output until all . expected sections have been 
received. Alternatively, the device may operate in a 
manual mode in which each section is transferred under 
the control of the application. 

Description cfi the MCOM device will concentrate 
on commands which are significantly different from 
those featured in the TS_REMUX device. 



This command is CALLed to define a numeric field 
of n bits long starting m bits from the beginning of an 
MPEG section at which a section identifier should be 
to found. 

The field defined can contain a numeric value c of 
from 0 to (2 A n - 1). 

Following this command, a bitmap of 2 A n bits is 
defined in memory, each bit corresponding to a section 
is to receive. For example, if n=8, a bitmap of 256 bits (32 
bytes) is defined, to flag receipt of 256 separate sec- 
tions. During receipt of sections from the demultiplexer 
the numeric value c of this field is extracted and the (c - 
1)th bit of the bitmap is tested; if the bit is set, the sec- 
20 tion is rejected. Thus automatic filtering of sections can 
be performed, in which a set bit can be used to signify 
that a section has already been received, or that no cor- 
responding section is to be expected. Of course, the bit 
may be reset, or receipt of sections flagged in a different 
25 way. 

The command allows the initial bitmap to be 
defined; all bits may be set or reset, or a specified bit- 
map may be set as the initial bitmap. 

Corresponding commands are provided for chang- 
30 ing the filter dynamically, for example in running mode, 
or for interrogating the current state of the filter. 

The bitmap (or other flag table) may be used to con- 
trol automatic queueing of packets until all expected 
sections have been received. 
35 This command is useful in allowing considerable 
_ flexibility over the format of MPEG sections that can be 
^ processed by the device with automatic filtering. 



40 



Command : MCQM PACKET DEL 



Command- MCOM INIT HOMM 

This command is used to configure the communica- 
tion port, and is CALLed with a buffer containing a port 
type identifier and specific data for that port. This com- 
mand is useful because it enables the MCOM device to 
operate with a variety of communication ports (for 



This command is CALLed to define portions of an 
MPEG section to be removed as part of the encapsula- 
tion process. For example, a start offset p and an end 
offset q may be defined, and the MPEG section "top and 
45 tailed" by removing p bytes from the start and q bytes 
from the end. 

This command and associated functionality ena- 
bles the important data to be communicated to be freely 

placed in the middle of an MPEG section • 

so ' 

Command MCOM PACKET HEADFR 

This command enables a header of a defined for- 
mat to be added to a received section; the header may 
55 include information conforming to a particular communi- 
cation protocol, for example TCP/IP, This command may 
operate in one of two modes, a USE_HEADER mode in 
which only the header is added, and a 
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USE_LG_HEADER mode in which the command also 
adds information concerning the length of the encapsu- 
lated packet, for example a defined additive constant 
plus the length of the section, as illustrated in Fig. 7. • 

In a similar manner, the device includes a com- s 
mand for adding a frame check sequence, for example 
a CRC (cyclic redundancy check) of 16 or 32 bits or an 
LRC on a defined section of the packet, for example 
starting after a start offset number of bytes and continu- 
ing until an end offset number of bytes from the end, w 
with the calculated value inserted immediately after the 
section checked. 

The device may also include a command for trans- 
lating characters, for example a list of characters to be 
"escaped" (i.e. substituted by a pair of characters com- 15 
prising a defied escape character and a defined value). 

The above commands and events are merely illus- 
trative, and the invention may be implemented in a vari- 
ety of ways, and, in particular, some commands may be 
combined with others which perform similar functions, 20 
or some may be omitted in simplified implementations. 
Hardware and software implementations of each of the 
functions may be freely mixed, both between com- 
mands and within a single command. • 

It will be readily understood that the functions per- 25 
formed by the hardware, the computer software, and 
such like are performed on or using electrical and like 
signals. Software implementations may be stored in 
ROM or FLASH, or may be patched in FLASH. 

It will be understood that the present invention has 30 
been described above purely by way of example, and 
modifications of detail can be made within the scope of 
the invention. 

Each feature disclosed in the description, and 
(where appropriate) the claims and drawings may be 35 
provided independently or in any appropriate combina- 
tion. / 

Claims 

40 

1 . Apparatus for processing a digital data stream com- 
prising: 

means for receiving a digital data stream com- 
prising a plurality of packets of information; 45 
means /or storing a list of specified packets to 
be selected from the received digital data 
stream; 

means for extracting packets or sections speci- 
fied It] said list from the received data stream; so 
and 

means for combining or processing the 
extracted packets or sections to produce an 
output data stream. 

: ■ - 55 . 

2. Apparatus according to Claim 1, -wherein the com- 
bining means is arranged to produce an output data 
stream adapted for storage on- a digital video 



recorder. 

3. Apparatus according to Claim 1, wherein the 
encapsulating means is arranged to produce an 
output data stream adapted for data communica- 
tion with a computer. 

4. Apparatus according to any preceding claim, 
wherein the received digital data stream is an 
MPEG data stream, the list comprising a list of 
packet identifiers or a list of sections to be selected 
from the received data stream. 

5. Apparatus according to any preceding claim, 
wherein the list includes priority information indicat- 
ing priority assigned to each packet, the apparatus 
being arranged to include packets with higher prior- 
ity in the output stream in preference to packets 
with lower priority in the event of the number of 
packets to be combined becoming too great for the 
data handling capacity of the output stream. 

6. Apparatus according to any preceding claim includ- 
ing means for storing at least one further list of 
packet identifiers and means for applying one or 
more specified processing operations to packets 
specified in the or each further list prior to inclusion 
in the output data stream. 

7. Apparatus according to any preceding claim includ- 
ing means for inserting further packets or sections 
into the output data stream. 

8. Apparatus according to any preceding claim 
wherein the means for porcessing the extracted 
sections is arranged to perform at least one of: cut- 
ting a header and/or footer from a received data 
section; adding a header and/or footer to a received 
data section; adding an indication of the length of a 
received section; and adding a frame check 
sequence. 

9. Apparatus according to any preceding claim includ- 
ing means for monitoring receipt of sections.- 

10. Apparatus according to Claim 9 having means for 
automatically queueing the data packets produced 
by processing received sections for transmission 
until said monitoring . means indicates that all 
expected sections have been received or until 
receipt of an instruction to stop from an application. 

11. Apparatus according to any preceding claim in the 
form of a device in a receiver/decoder, arranged to / 
operate under the control of an application, via a/ 
device manager. ..-../ 

1 2. A device for operating under the control of an ap 
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cation to process a received digital data stream to 
produce an output stream therefrom, the device 
comprising: 

means for receiving a digital data stream com- 
prising a plurality of packets of information; 
means for receiving from an application infor- 
mation for compiling a list of specified packets* 
or sections to be selected from the received 
digital data stream; 

means for extracting, packets or sections speci- 
fied in said list from the received data stream* 
and 

means for combining or processing the 
extracted packets or sections to produce said 
output data stream. 

13. A device according to Claim 12 arranged to operate 
m one of two modes, the modes comprising an idle 
mode in which no output stream is being produced 
and a running mode in which data is passing 
through the device. 

14. A device according to Claim 13 including means for 
receiving commands from an application for switch- 
ing between said modes. 
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15. 



A device according to Claim 13 or Claim 14 includ- 
ing means operative in said idle mode to receive 
information for compiling said list in the form of an so 
initial list of packet identifiers to be copied to the 
output stream. 



16. A device according to Claim 13, 14 or 15 including 
means operative in said running mode to receive a 35 
list of packet identifiers to be added to or deleted 
from the current list. / 

4* 

1 7. A device according to any of Claims 1 1 to 1 6 further 
comprising means arranged to maintain a further 40 
list of packets to be descrambled. 

18. A device according to Claim 1 7 arranged to receive 
information for use in descrambling from an appli- 
cation, preferably as part of a procedure for setting 4s 
the initial list pf packets to be descrambled. 

1 9. A device according to any of Claims 1 1 to 1 8 further 
comprising means for storing a list of MPEG sec- 
tions to be inserted by an application. so 

20. A device according to Claim 19 arranged to receive 
parameters from an application for controlling repe- 
tition of the section in the output stream, the device 
being arranged to repeat the section based on the ss 
parameters. 

21 . A device according to any of Claims 1 1 to 20 further 



compnsing means for returning to an application 
information concerning the currently selected 
packet identifiers or sections included in the output 
stream. y 

22. A data processing system comprising : 

run-time engine means for running at least one 
application; 

means for receiving a broadcast digital data 
stream; 

a device according to any of Claims 1 1 to 21 for 
processing the received digital data stream 
under the control of the or each application; 
means for supplying the data stream output by 
the device to an output interface. 

23. A data processing system according to Claim 22 
implemented in a receiver/decoder, the 
receiver/decoder including means for receiving the 
broadcast digital data stream from a satellite 
receiver or cable and said interface, the interface 
being arranged for connection to a digital video 
recorder or digital display device or computer for 
display or storage of at least a portion of the 
received data or to provide a communication link to 
the computer. 

24. A receiver/decoder according to Claim 23, wherein 
the device is arranged to co-operate with a device 
driver for outputting the output data stream to the 
interface. 

25. A receiver/decoder according to Claim 24 wherein 
the interface conforms to the IEEE 1394 standard 
or a variant or modification thereof. 

26. A receiver/decoder according to any of Claims 24 to 
25 arranged for connection to a digital video 
recorder, the receiver/decoder including an applica- 
tion arranged to control the device to select portions 
of the received data stream comprising two or more 
television programmes for outputting to the digital 
video recorder and means for adding information to 
the output data stream identifying the programmes. 

27. An application for a receiver/decoder having means 
for receiving a broadcast digital data stream an 
interface for connection to a digital storage medium 
and a device for processing the received digital 
data stream to produce an output data stream for 
supply to the digital storage medium, the applica- 
tion comprising means for controlling said device to 
select portions of the received digital data stream 
corresponding to two or more broadcast pro- 
grammes and for outputting the portions to the dig- 
ital storage medium for storage in a form enabling 
the programmes to be played back subsequently. 
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28. A receiver/decoder incorporating a device substan- 
tially as herein described. 

29. A device substantially as herein described. 
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